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ABSTRACT 

In measuring attitudes by Semantic Differential, 
bipolar adjective scales with high loadings on an evaluative factor 
derived by Principal Components Analysis are used typically as 
unidimensional attitude measures • Komorita and Bass, using 
conventional statistical techniques, report the discovery of more 
than one evaluative factor. This paper focuses on four considerations 
for establishing evaluative factors: concept complexity, eigenvalue 
cutoff criteria, eigenvalue plot, and conceptual analysis of scale 
groupings* Komorita^s and Bass's data and new data from ratings of 
six concepts of varying complexity are analysed and discussed* 
Specific recommendations are made regarding determination of 
evaluative scales in attitude research* (Author) 
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J Semantic Differential scales are widely used for attitude 

I g measurement both in research and applied settings. Frequently, a 
I unidimensional conception of attitude is either expressed or implied 
I by investigators in selecting scales which load on an-i'-evaliiative" 
1 factor TE). Difficulties arise, however, where more tharione~factor" 
6 ??or?f^ ^® labeled as "evaluative". Komorita and Bass 

I (1967), for examplt, report finding three E factors in principal 

|| components analysis of data from 220 Ss • ratings on 16 bipolar ad- 

II 3®ftive scales of the concepts "American Foreign Policy in Vietnam" 

I and Draft Deferments for Married Students". The scales were 

II selected on the basis of previously reported high loadings on a 

If single E factor (Osgood, et al. , 1957). Komorita and Bass' finding 
I creates difficulties for attitude research. If the 'three E solution-; 
P were general, then to operatxonalize a hypothetical "attitude" con- 
I struct using S.D. scores would be hazardous; does one use one E, two 
- Es, or three Es? How many Es are there ? 

Objectives of this paper involve analysis and comparison of new 
m f • ^^^^ concerning the determination of evaluative factors under- 
lying Semantic Differential scales for use in attitude measurement. 
Specifically, this work focuses on the problems associated with one 
or more E factors. 



Data and Procedures 

New analyses of Komorita and Bass' correction matrices were 
perfonned. We chose data gathering and statistical analysis pro- 
cedures which are most widely-used and available for attitude re- 
search. Thus, principal components analysis and Varimax rotation 
procedures ("Little Jiffy") were used. Alternate analyses were 
performed to check the suitability of "Little Jiffy". Additionally, 
^ Veldman s (1967) "Relate" procedure was used to compare different 
Iv^^**^ solutions. In the reanalysis of Komorita and Bass' data, 
three common conventions for determining the number of factors to 
rotate were investigated: eigenvalue cutoff criterion, eigenvalue 
(and log eigenvalue) plot {C«ttell, 1966, p.206) , and that each 
additional factor must contribute more than 5% once 75% of the total 
\ variance IS accounted for (Harnwiu, 1968, p.l68) . since the eigen- 
r-v H® criterion had been used in the study reporting three E 
O factors, the same data were reanalysed by rotating, two, three, and 
four factors orthogonally and oblicaisly. 
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Miron (1972) suggested that with a small number of concepts, 
oblique rotation may more accurately characterize the "meaning domain" 
of the concepts. To check this we performed oblique rotations on the 
Komorita and Bass data and compared results to Varimax rotations. A 
direct quartimin rotation produced essentially the same factor struc- 
ture in terms of scale loading patterns as the Varimax rotation shown 
in Table 5. Based on these results, Varimax rotations were used ex- 
clusively for subsequent analyses. However, it should be noted that 
correlations between obliquely rotated factors (from -.59 tc +.36) 
suggest a more cautious interpretation of multiple E factors. The 
question of oblique vs. orthogonal rotation was deferred for later 
study. 

Nonstatistical analyses of concept verba l comple xity and logical 
scale groupings were considered. The two original cottcepts were 
phrased such that Ss could potentially focus on a part of the stated 
concept (e.g., only upon "American Foreign Policy"). We decided to 
compare the factor structures of two verbally "wordy" concepts, in- 
cluding one of those originally used by Komorita and Bass with the 
structures of four verbally "simpler" ones. New data were collected 
and analysed using over 100 Ss' (Canadian College Students) ratings of 
the concepts "American Foreign Policy in Vietnam", "Economic Develop- 
ment of Northern Canada", and the verbally simpler concepts "American 
Foriegn Policy", "Vietnam", "Economic Development", and "Northern 
Canada". The same 18 bipolar adjective scales were used for each 
concept, including all 16 scales from the original Komorita and Bass 
study. 

Results 

Number of Factors to Rotate . Using the conventional eigenvalue 
cutoff criterion (eigenvalue > 1) produced an arbitrary distinction be- 
tween two statistically similar factors. Results shown in Table 1 in- 
dicate Factors III and IV, for both concepts, are associated with 
eigenvalues barely above and below 1, respectively. Discarding 
Factor IV solely on the magnitude of its associated eigenvalue would 
render questionable the retention of component three with a nearly 
identical value. Thus, a two or four factor solution might be pre- 
ferable to the three factors originally reported. 



INSERT TABLE 1 ABOUT HERE 



The importance of the fourth component became clearer when 
Veldman's (1967) "relate procedure" was applied in order to maximize 
the fit between the three- and four-factor solutions. The cosines of 
the angles between the factors produced in the "relate procedure" are 
shown in Table 2. These cosines can be interpreted in the same way as 
correlation coefficients between factors. 
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For the concept "American Foreign Policy in Vietnam", Factor IV 
has a substantial negative correlation with Factor ill of the tbree- 
f actor solution, and Factor IV is comparatively uncorrelated with the 

I V'^'.J^^ concept "Draft Deferments for Married 
Students , Factor IV proves to be statistically separable from the 
flr^or ?S l^""' J^f^® results indicate Factor IV is a separate 

• ^^J^^'^ ^® '}'^^^^ ^^^^ fourth factor is produced i^ 
contradickion to Komorita and Bass' suggestion of a three factor 
Jnf?S™®/5°'' ^^t^"" ^!f° concepts. The only difference between the two 
analyses (Komorita and Bass' and that performed here) is the employ- 
ment of eigenvalue cutoff criteria-producing two, three, or four 
factors rather than an eigenvalue cutoff criterion greater than or 
equal to one-producing exclusively a three-factor solution. 

.!!lJ^2f:^^?"^f^°^°^ ^^^"^^ proportion of total .variance- 



Jh!n ^2 J^? solution to around 75% (Table 1) . Barely more 

nn?nr ..S^--^"^^?- variance is attributable to Factor IV. Harman 
-^«^-7P0tnti out that the 75 + 5% criterion is a standard for de- 
termining number of rotation factors. Based on this criterion, a 
4-f actor structure can be rotated. 

Eigenvalue plots may be employed in two ways. The log of the 
eigenvalue for each factor can be plotted against the ordinal value 

of f!^!«^: -^^ ^5^^ ^^'^^ visually illustrate the magnitude 

om^Ski in order to decide whether or not the factors are 

^ ^s to plot the actual eigen- 

^SiS^se in^fnS p.-^""^? ^9^^"' ^^^h the same 

M«S^ ^ !^^9ure 1 and Figure 2 demonstrate eigenvalue plots 

IXoJor-;? i/^^^' Respectively), for Komorita and Bass' data 
P^o^or ??^V.Si®?f^?,'«Sf e^^^ concept change direction at 

Itt^^l ' J^^^^^l^ ^^^^V suggests that factors lying beyond the 
«?Sr^r^f considered residual or "Scree". Based upon these 

criteria, one, perhaps two factors, could be selected for rotation. 



INSERT FIGURES 1 AND 2 ABOUT HERE 



^. At this point, it ap pears that the number of E factors, one, two, 

!uur;.L.' 'T:^!.^"^ ^ T^!^ ^" ^ ^^^a set depends on the staultic ^ 
convention adoptea for factor selection. ■ ~ 



Nonstatistical Consideration..; . m general, it should be noted that a 
I f^niiZ Jt^^'l oo"o^Pt "ay be associated with a single or multiple 
o/fu! structure. Conversely, a verbally "simple" concept (oneT two, 
or three words) may be associated with either a simple or multiple 
coSceptuSS2Sr- concept-factor-structSre types cal be 



TYPE 1 
TYPE 2 
TYPE 3 
n'YPE 4 



"Single" concept/single E factor 
"Single" concept/multiple E factor 
"Wordy" concept/single E factor 
"Wordy" concept/multiple E factor 



FIGURE 1 




i 2 3 4 



Ordinal value of root 
"AMfiRICM f'ORFJIGN POLICY XN VIETNAM" 




12 3 4 



Ordinal value of root 
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Table 3 contains an illustration of each type for the six con- 
cepts, three for "American Foreign policy in Vietnam" and three for 
Economic Development in Northern Canada". The emphasis here is on 
concept effects not on the possibilities of concept by scale or concept 
by person interactions. These are discussed briefly below. 



INSERT TABLE 3 ABOUT HERE 



Logical analyses of "evaluative" scales reveal a variety of scale 
clusters which can be checked empirically. Komorita and Bass described 
a three E factor structure for the two concepts with 10 common scales. 
They used a factor loading cutoff criterion of 0.50. We used 
Veldman's "Relate" procedure to check empirically Lheix bulut ien-.— As 
-illustrated. In. Table 4, more scales could be included, but the com-^ 
posite scale clusters seem similar. Also, Komorita and Bass' E 
factor labels seem to be appropriate. 



INSERT TABLE 4 ABOUT HERE 



Evaluative labels for scale clusters play a role in determining 
what IS considered to be"evaluative. " Komorita and Bass interpreted 
their composite 3-f actor solution as three evaluative components, 
functional-utilitarian", "affective-emotional", and "moral-ethical" 
(Table 5) . The 4-f actor composite solution shown in Table 5 yields 
a fourth component which could be interpreted and labelled "com- 
passionate". Factor IV was derived by teasing out scales "kind- 
cruel", and "clean-dirty" from Factors II and III, respectively. 
In addition, the "fair-unfair" scale shifted to the "moral-ethical" 
component and scales "nice-awful" and "agreeable-disagreeable" be- 
came more ambiguQys in their loadings. Thus, the 4-f actor solution 
retains the basic pattern proposed by Komorita and Bass, but may 
provide additional insight into the data. 



INSERT TABLE 5 ABOUT HERE 

Discussion 

With the ihelp of Komorita and Bass' data, we have tried to 
demonstrate the effects of three traditional criteria for selecting 
factors to rotate. The criteria are: 

1. Eigenvalue = 1 

2. Eigenvalue (and log eigenvalue) plot 

3. 75+5% total variance 



TABLE 3 , Concept Complexity and Multiple E Factors 



CONCEPT 


TYPE^ 


# FACTORSt" 


% Variance Accounted 


"Vietnam" 


1 


1 


75.2 


"American Foreign 
Policy" - 


~2 




77.6 


"Anierican Foreign 
Policy in Vietnam" 


3 


1 


81.8 


"Economic Development*' 


2 


3 


71.3 


"Northern Canada*' 


2 


4 


70.5 


"Economic Development 
in Northern Canada" 


4 

i_ -t 


3 


78.4 



^ TYPE A - *'oimple" Concept/vSingle E factor 

2 - "Simple" Concept/Multiple E factors 

3 - "Wordy" Concept/Single E factor 

4 - "V7ordy" Concept/Multiple E factors 

^ N>100 {Canadian College Students) 



TAE1.E 4. Conposite Scales for Characteri^^ing the Three- 
iactor Solution based on combiiiiiig "the Conceots 
using Veldman's "Fieiate' Procedure 




a Factor loadings are available upon request, 
b Scales characterized by the "relate" procedures, but 
rejected by Komorita and Bass. 
^ Komorita and Bass' labels. 



Table 5, Composite of Scale Clusuers Tor Komorita and Bass' 
Data using a 4-B'actor Solution 
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13 
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agreeable^' 


agreeable 






A 

1 

j 
1 
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15 
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satisfactory 




sincere 















^ Based on a reanalys.is of Komorita and Ba'^s * data using Veldnian's 
^ "Relate'* Procedure. 

Factor loadings shown are 0.50. 
° Factor loadings 0.50 in more than one factor. 
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«Lno Veldman's "Relate" procedure was demonstrated as one 

nonsLS^cJ?^!^^"^ factor structures. Finally, we described three 
nonstatxstical considerations which influence decisions concerning 
ractor interpretation. These are: 

1. concept complexity 

2. scale clustering 

3. factor labelling 

eauivnn^''"®^^^°^ ^^L J^°^' ^^^^ "^^^^ answer remains 

- ^ '^i^'^l' ''^''^ statistical convent ^ . planned for the 
data analysis? Second, what definition of tuoe is preferred by 

c^^ir^«^^^^^°''' ^^^^ interactions between concepts, 

. persons are expected and observed in the data? Depending 
Se ?nt 4r2?rrfc^° these questions, the Komorita and Bass data could 

-^f u ^ °^ fo"^^ factor solution, all 

criteria °^ conventional statistical and/or logical 

Implications for Appl ication of Cont^nporary Attitude Theory 

util J2r-?^n?''^f ^ J!?"^ fi"^i"9 of 3 E factors: 1) functional- 

added JSnLcK-f-^^^^r'^r^^^^!^^' 3' moral-ethical, we have 

added the possibility of a fourth. Prom their own data, a 



?SIe to ^o?.?^^iK- ^r^^"" ^^^^^^ ^^^^ ^^^1^^ eigenvalue magni- 
Son nf component. Clearly, one's a priori defini- 

here attitude" can be a guide in deciding how to pr oceed f rom 

/jshbein (1967) harking back to early work of L.L. Thurstone, 

"the fL^n^"o^^?<=''^^.^°'' ^ unidimensional definition of attitude as, 
the amount of affect for or against a psychological object" (p.389) . 

*eJL;it?on"ofTio'^^ r.^" evaluative responle which indexes one's 

evaluation of a concept (i.e., its 'goodness or badness'), p.389. 
t^^rj;^^?' investigators who operate from this point-of-vi^w iould 
tT.V^t component having the highest Loadings with the go^-bad 

hfitf^ " °^ attitudes, other "E components" might be taken 

wL u^ilul statements of the probability that ?he concept 

evfluftfvi'.cn»!i' con'Passionate, etc. Moreover, attitudes taken as 

?^P®<=ts Of beliefs need not necessarily be indexed by 
scores which are orthogonal to belief scores. naexea py 

were to hold a multidimensional conceptualization of 
attitude (e.g., Krech, Crutchfield, and Ballachey, 1962), the problem 
then becomes to assign multiple E factors to one or more of the 
a giori construct dimensions. Of "cognition", "affect" and "conation" 
goSapi and badness (like Fishbein's "attitud^") would appear ?S 

S!l?^fc"?^^K°^"r^^ ^° cognition might be associated wi?h 

beliefs (other "E components "and possibly P and A), whereas conation 
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w*.li /Sk ^ ""^^f empirical stance, one could accept a 

well-developed Thurstone, Likert or Guttman scale (for instance) 
hLh n^c ^r^^°P semantic differential scales iuh an eye to 
^a??i?ule"'i:^n??c?f ^^'^ standard. The definition ol^ 

"bj 'a^^ttuS' ^^L^^^K °^ Stephens' famous phrase, 

measi ..^ "^^"^ (well-developed) attitude scale 

shouirno^ir^ ff^-^^^T-ir''!^?" ^^^gest that the investigator 

should not let Little Jiffy define what he means by attitude rather 
he should define his construct before he begins the caref Si process 
of developing appropriate concepts and scales (C.F. Nunnallv ?967^ 
clprselec?ionK """'^ '''' advice 'of scaie^ind'coi- 

Suggestions for Furthe r Research and Implications for Practice 

to beiare^of^conJIfnJ°"^°" ?° caution users of the semantic differential 
to Deware of concept - scale interactions, and to investioate the 
factor structure of intended scales for oie's concents aid qc 7» « 
Nunnally, 1967, pp 539-540). More recen??y, releSc^LrLl prac?i: 
tioners have been advised to specify logically (HeilefgtS) ^fnS 

™t'doL?S^"r^''^ (McKie'and LstL'^'iJ^s/^^L^^tr'uc^iie'S? the 
concept domain under consideration. The present study in the context 
aL^Jn^rr"''^ literature on semantic differential aLJJsis anl 
a^e S?Id be?SS!^'"' '"^'^"^ considerations, some o? these 

uiuf^!Al^L^^^"°^''^ desirability . Nichols and Shaw 

<J964) purport to provide evidence to the effect that as "salience" 
of a concept increases for a group of subjects (e.g., concept "Shurch" 
as opposed to "college professor" for a g^oup of chuichgSers) corre- 

?6^?o^ ^^T^^v ^ Thurstone sIale%cores 5rSp (e!g.? f^om 

.76 to .39). Presuming that this finding is reliable (a 24 item 
Thurstone scale and a 5 scale SD, measuring a "highly-re?ined"T 

s?rSc?u?e Tsav a?f 1^^' were^a mSufple E 

iSasina siftLof J^^'''^'.^''^^ functional) whether with'^in- 
creasing salience, the pattern of correlations with an external 

?ec,n?c*^-^^*^*\T^""*^°"« "i^ht not shif « PeJhIps saUence 

senaraJio^ o? ^"^1?^^*^^°" variance in one E componeS?rbu? c!ear 
?h?^J?3 ? ° lf°P^® ^ dimension is associated' with a more 

(highly focused) specific set of beliefs about the objic? or concept 

Likewise, Ford and Meisels (1965) show high correlations between 
bnfT^Sn''^ determined E factor and a measure of social Slsira- 
bility. The pattern of such correlations across multiple Es for a set 
of concepts, scales and persons would be of potential interest as 
would the relationship between social desirability and "sSilnie" as 

r^airS tTllrfo'r^^^' '^^ '"^^'^''^'^ ^^"^ relatld^'^%TtionI 
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One approach to such a problem might be in the use of three- 
mode factor analysis (Tucker, 1966), wherein a cube of persons by 
concepts by scales data is factored without having to collapse along 
one dimension. Wiggins and Fishbein (1969), in fact, have provided 
evidence for "person" factors. Thus, it might not be sufficient to 
consider merely concept by scale interactions, but also interactions 
of persons by concepts (e.g., Nichols = and Shaw, 1964), persons by 
scales (e.g., Wiggins and Fishbein, 1969), and the triple inter- 
action, persons by scales by concepts. 

Conclusions 



Investigators and consumers of research alike need to be wary 
of the conventions for when to stop factoring. Blind dependence 
upon the machine and on widely-used procedures may well yield confu- 
sing or misleading results. Moreover, an a priori attitude construct 
and Its clearcut operational definition are sine qua non as pre- 
requisites to the design of research in this area. The~finding of 
multiple "evaluative" factors or components is not new (C.F. Osgood, 
et al. 1957) . It does, however, present problems for attitude 
theory as well as empirical issues, which require recognition if 
not resolution, in practice. We have attempted to identify some 
key statistical and conceptual considerations, and suggest some 
areas requiring further research. 
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In order to check the principal componcn'cs results 
in terms of factor reliability Alpha Factor Analysis 
was performed (Kaiser, H,F,, and Caff res, T. "Psycho- 
metric method of factor analysis" unpublished paper, 
1963) • For comparability the data factored were 
Komorita and Bass' matrix of scale intercorrelations 
for the concept "American Foreign Policy in Vietnam", 
and our data matrix for the ^^ame concept. (The IBM 360 
computer at the University uf Illinois at Champai:jn- 
Urbana was employed for these analyses) . 

The results of the Alpha Factor Analysis are 
unmistakably clear. There is only one E factor aosoci- 
ated with acceptable levels of reliability! The three 
Alpha Reliabilities of the three Komorita and Bass "E" 
factors are .98, .64, and .24, respectively. For the 
new data, factors I and II had reliabilities of .996 
and ,051 respectively. 



